Application of flipped classroom teaching method based on ADDIE concept in clinical teaching for neurology residents.

BACKGROUND: As an important medical personnel training system in China, standardized residency training plays an important role in enriching residents' clinical experience, improving their ability to communicate with patients and their clinical expertise. The difficulty of teaching neurology lies in the fact that there are many types of diseases, complicated conditions, and strong specialisation, which puts higher requirements on residents' independent learning ability, the cultivation of critical thinking, and the learning effect. Based on the concept of ADDIE (Analysis-Design-Development-Implementation-Evaluation), this study combines the theory and clinical practice of flipped classroom teaching method to evaluate the teaching effect, so as to provide a basis and reference for the implementation of flipped classroom in the future of neurology residency training teaching. METHODS: The participants of the study were 90 neurology residents in standardised training in our hospital in the classes of 2019 and 2020. A total of 90 residents were divided into a control group and an observation group of 45 cases each using the random number table method. The control group used traditional teaching methods, including problem based learning (PBL), case-based learning (CBL), and lecture-based learning (LBL). The observation group adopted the flipped classroom teaching method based on the ADDIE teaching concept. A unified assessment of the learning outcomes of the residents was conducted before they left the department in the fourth week, including the assessment of theoretical and skill knowledge, the assessment of independent learning ability, the assessment of critical thinking ability, and the assessment of clinical practice ability. Finally, the overall quality of teaching was assessed. RESULTS: The theoretical and clinical skills assessment scores achieved by the observation group were significantly higher than those of the control group, and the results were statistically significant (P < 0.001). The scores of independent learning ability and critical thinking ability of the observation group were better than those of the control group, showing statistically significant differences (P < 0.001). The observation group was better than the control group in all indicators in terms of Mini-Cex score (P < 0.05). In addition, the observation group had better teaching quality compared to the control group (P < 0.001). CONCLUSION: Based on the concept of ADDIE combined with flipped classroom teaching method can effectively improve the teaching effect of standardized training of neurology residents, and had a positive effect on the improvement of residents' autonomous learning ability, critical thinking ability, theoretical knowledge and clinical comprehensive ability.

Assessing Residents in the Department of Surgery at a Tertiary Care Centre Using Mini-Clinical Evaluation Exercise (Mini-CEX).

OBJECTIVE: This study aimed to introduce, sensitize, and train our postgraduate students and faculty of the department of general surgery with the use of mini-Clinical Evaluation Exercise (mini­CEX) and to assess the perception of students and faculty towards it. MATERIAL AND METHODS: A cross­sectional observational study was conducted over a period of four months. Ten surgery residents in the department were asked to volunteer to participate and five professors conducted the session. Five sessions of mini­CEX (nine points) were conducted for each resident in different settings of the out­patient department (OPD) and in­patient department (IPD). A total of five skills were tested. Feedback from faculty and residents regarding the perception of mini­CEX was also taken. RESULTS: A statistically significant difference in mean scores of all domains was observed comparing the first and last assessment (p<0.05). Hundred percent of the residents scored superior category (7-9) in the final assessment in all domains, whereas the maximum was in a satisfactory scoring grade in 1st assessment. The time taken for the assessment significantly reduced from 1st assessment to the last assessment in OPD and IPD settings (p=0.001). The mini-CEX assessment tool got 100% feedback from faculty in terms of skill improvement, method, attitude of residents, and ability to identify gaps in knowledge. However, one assessor thought that "time given for assessment" was inadequate and more effort was required than the usual traditional assessment methods. The most identified problem faced by residents was that the "time given during assessment" was less (50%); however, overall residents also found it valid, effective, and helpful in identifying knowledge gaps and improving clinical and communication skills. CONCLUSION: Mini­CEX improves the learning environment in residency and also leads to improvement in medical interviewing skills, physical examination skills, humanistic qualities/professionalism, and counseling skills. So, it can be used for residency training in clinical departments.

Implementación del mini-CEX en el pregrado médico: Una experiencia con simulación / Implementation of the Mini-CEX in Medical Undergraduate Education: A Simulation-Based Experience

Resumen La evaluación es un proceso sistemático que resulta en un juicio de valor para tomar decisiones. Los instrumentos empleados para obtener datos sobre el desempeño de los estudiantes requieren de un proceso sistemático y objetivo para su implementación. El mini-CEX es un instrumento de observación directa que ha sido empleado para la evaluación de la competencia clínica en los estudiantes de pre y posgrado desde su invención en 1955. Cuenta con diferentes evidencias de validez para su uso en distintos contextos educativos y clínicos. Permite realizar evaluaciones rápidas, acompañadas de realimentación y que proporcionan información relevante del desarrollo de la competencia clínica. El objetivo de este escrito es exponer la experiencia de la implementación del mini-CEX en el pregrado médico para la evaluación formativa de los estudiantes utilizando la simulación con pacientes estandarizados. Para lograr este objetivo se empleó la siguiente secuencia: búsqueda, planeación, integración y aplicación. Posterior a estos pasos se dan una serie de recomendaciones para la implementación del mini-CEX. Se concluye que la evaluación de la competencia clínica es importante para la mejora continua y permanente de los estudiantes de pre y posgrado. Es necesario sistematizar la evaluación ajustada siempre a objetivos y necesidades específicas de la evaluación.

Abstract Evaluation is a systematic process that results in a judgment to make decisions. The instruments used to obtain data on student performance require a systematic and objective process for their implementation. The mini-CEX is a direct observation tool that has been used for the evaluation of clinical competence in undergraduate and postgraduate students since its invention in 1955. It has different validity evidence for use in different educational and clinical contexts. It allows rapid evaluations, accompanied by feedback and providing relevant information on the development of clinical competence. The objective of this paper is to expose the experience of the implementation of the mini-CEX in the medical undergraduate for the formative evaluation of students using simulation with standardized patients. To achieve this goal, the following sequence was used: search, planning, integration, and application. After these steps we make some recommendations for the implementation of the mini-CEX. Its is concluded that the evaluation of clinical competence is important for the continuous and permanent improvement of undergraduate and graduate students. It is necessary to systematize the evaluation always adjusted to objectives and specific needs of the evaluation.

The Utility of the Mini-Clinical Evaluation Exercise (Mini-CEX) in the Emergency Department: A Systematic Review and Meta-Analysis Evaluating the Readability, Feasibility, and Acceptability of Mini-CEX Utilization.

Assessment tools, such as the mini-clinical evaluation exercise (mini-CEX), have been developed to evaluate the competence of medical trainees during routine duties. However, their effectiveness in busy environments, such as the emergency department (ED), is poorly understood. This study assesses the feasibility, reliability, and acceptability of implementing the mini-CEX in the ED. PubMed, Google Scholar, ScienceDirect, Scopus, and Web of Science databases were scoured for observational and randomized trials related to our topic. Moreover, a manual search was also conducted to identify additional studies. After the literature search, data were extracted from studies that were eligible for inclusion by two independent reviewers. When applicable, meta-analyses were performed using the Comprehensive Meta-Analysis software. In addition, the methodological quality of studies was evaluated using the Newcastle-Ottawa Scale. Of the 2,105 articles gathered through database and manual searches, only four met the criteria for inclusion in the review. A combined analysis of three studies revealed that trainee-patient interactions averaged 16.05 minutes (95% CI = 14.21-17.88), and feedback was given in about 10.78 minutes (95% CI = 10.19-11.38). The completion rates for mini-CEX were high: 95.7% (95% CI = 87.6-98.6) for medical trainees and 95.8% (95% CI = 89.7-98.3) for assessors. Satisfaction with mini-CEX was notable, with 63.5% (95% CI = 51.5-74.1) of medical trainees and 75.7% (95% CI = 63.9-84.6) of assessors expressing contentment. Qualitative data from one study demonstrated that 70.6% of faculty members could allocate suitable time for mini-CEX during their clinical shifts. The mini-CEX is a feasible and acceptable assessment tool within the ED. Furthermore, there is evidence to suggest that it might be reliable.

Designing and implementing an OMMID midwifery professional competence mixed test: A multimethod, multiphasic study.

The assessment of professional competence is essential to ensure the achievement of competence standards. The goal of this study is to design and implement a professional competence test model to make the test unified, comprehensive, and fair. This research was a multimethod, multiphasic study. The first qualitative phase of the nominal group technique was conducted to design the test model with specific guidelines. The second phase was a mixed-method parallel field trial conducted on 161 senior midwifery bachelor students in universities of Iran. The test was conducted following the traditional method in the control group and OMMID model in the intervention group. This model consists of three parts: the MCQs (multiple choice questions), OSCE (objective structured clinical examination), and clinically-oriented tests, which included Mini-CEX (mini-clinical evaluation exercise) and DOPS (direct observation of procedural skills). Data were collected using questionnaires and interviews, and the results were assessed qualitatively and quantitatively. The OMMID model and the associated guideline were designed. Qualitative data analysis resulted in six main themes, including organizing, structure, tension due to change, fairness, unification, and outcome. The OMMID model did not increase students' anxiety and stress and did not decrease their satisfaction. The merits of this model include having a centralized guideline, using multiple evaluation methods, comprehensive evaluation of necessary skills, promotion of fairness, and increased student satisfaction.

Do clinical interview transcripts generated by speech recognition software improve clinical reasoning performance in mock patient encounters? A prospective observational study.

BACKGROUND: To investigate whether speech recognition software for generating interview transcripts can provide more specific and precise feedback for evaluating medical interviews. METHODS: The effects of the two feedback methods on student performance in medical interviews were compared using a prospective observational trial. Seventy-nine medical students in a clinical clerkship were assigned to receive either speech-recognition feedback (n = 39; SRS feedback group) or voice-recording feedback (n = 40; IC recorder feedback group). All students' medical interviewing skills during mock patient encounters were assessed twice, first using a mini-clinical evaluation exercise (mini-CEX) and then a checklist. Medical students then made the most appropriate diagnoses based on medical interviews. The diagnostic accuracy, mini-CEX, and checklist scores of the two groups were compared. RESULTS: According to the study results, the mean diagnostic accuracy rate (SRS feedback group:1st mock 51.3%, 2nd mock 89.7%; IC recorder feedback group, 57.5%-67.5%; F(1, 77) = 4.0; p = 0.049), mini-CEX scores for overall clinical competence (SRS feedback group: 1st mock 5.2 ± 1.1, 2nd mock 7.4 ± 0.9; IC recorder feedback group: 1st mock 5.6 ± 1.4, 2nd mock 6.1 ± 1.2; F(1, 77) = 35.7; p < 0.001), and checklist scores for clinical performance (SRS feedback group: 1st mock 12.2 ± 2.4, 2nd mock 16.1 ± 1.7; IC recorder feedback group: 1st mock 13.1 ± 2.5, 2nd mock 13.8 ± 2.6; F(1, 77) = 26.1; p < 0.001) were higher with speech recognition-based feedback. CONCLUSIONS: Speech-recognition-based feedback leads to higher diagnostic accuracy rates and higher mini-CEX and checklist scores. TRIAL REGISTRATION: This study was registered in the Japan Registry of Clinical Trials on June 14, 2022. Due to our misunderstanding of the trial registration requirements, we registered the trial retrospectively. This study was registered in the Japan Registry of Clinical Trials on 7/7/2022 (Clinical trial registration number: jRCT1030220188).

Application of flipped classroom based on CDIO concept combined with mini-CEX evaluation model in the clinical teaching of orthopedic nursing.

BACKGROUND: After the COVID-19 epidemic, the state has paid more attention to the clinical teaching function of affiliated hospitals of colleges and universities. Strengthening the integration of medicine and education and improving the quality and effect of clinical practice teaching are critical challenges facing medical education. The difficulty of orthopedic teaching lies in the characteristics of a wide variety of diseases, strong professionalism, and relatively abstract characteristics, which affect the initiative, enthusiasm, and learning effect of nursing students. In this study, a flipped classroom teaching plan based on the CDIO (conceive-design-implement-operate) concept was constructed and practiced in the orthopedic nursing student training course to improve the effect of practical teaching, and it is convenient for teachers to implement more effective and targeted teaching in the flipped classroom of nursing education and even medical education in the future. METHODS: Fifty undergraduate nursing students who practiced in the Orthopedics Department of a tertiary hospital in June 2017 were enrolled in the control group, while 50 undergraduate nursing students who practiced in the same department in June 2018 were enrolled in the intervention group. The intervention group adopted the flipped classroom teaching mode of the CDIO concept, whereas the control group adopted the traditional teaching mode. After finishing the department practice task, the students in the two groups completed the evaluation of theory, operation skills, independent learning ability, and critical thinking ability. They completed the evaluation of clinical practice ability in eight dimensions, including four processes of nursing procedures, humanistic care ability, and evaluation of clinical teaching quality for two groups of teachers. RESULTS: After teaching, the clinical practice ability, critical thinking ability, autonomous learning ability, theoretical and operational performance, and evaluation of clinical teaching quality in the intervention group were significantly higher than those in the control group (all p < 0.05). CONCLUSION: The CDIO-based teaching mode can stimulate the independent learning ability and critical thinking ability of nursing interns, promote the organic combination of theory and practice, improve their ability to comprehensively use theoretical knowledge to analyze and solve practical problems, and improve teaching effectiveness.

Effect of Workplace-Based Assessment Utilization as a Formative Assessment for Learning Among Family Medicine Postgraduates at the Faculty of Medicine, Menoufia University: A Prospective Study.

Background Workplace-based assessment (WBA) is a group of assessment approaches that assesses the trainees' performance through their observation and monitoring in real clinical settings and then provides them with constructive and relevant feedback. Many WBA tools are available, including the mini-clinical evaluation exercise (mini-CEX), direct observation of procedural skills (DOPS), case-based discussions, and multisource feedback (peers, seniors, and patients). A WBA can help medical students improve their clinical competencies and ensure that qualified physicians graduate. Methods This prospective study was done in the family medicine department at the Menoufia Faculty of Medicine in Egypt and passed through two phases. Phase I was introducing an orientation lecture for family medicine staff and a convenient sample of 21 family medicine postgraduates about WBA. Phase II was conducting a monthly mini-CEX and DOPS for the postgraduates. Finally, students' satisfaction with the WBA was assessed, and all collected data were analyzed via Statistical Package for Social Science (SPSS) version 23 (IBM Corp., Armonk, NY). Results A total of 105 feedback sheets were obtained. These feedback sheets were subdivided into 63 mini-CEX feedback sheets (21 sheets from each mini-CEX session for three sessions) and 42 DOPS feedback sheets (21 sheets from each DOPS session for two sessions), all of which were collected and analyzed. A significant improvement was detected in the mini-CEX and DOPS feedback scores of the postgraduates throughout the consecutive sessions (9.5 ± 2.7, 24.9 ± 2.5, 27.29 ± 1.5) (P < 0.001) for Mini-CEX and (6.1 ± 1.8 versus 9.0 ± 1.2) (P < 0.001) for DOPS. About 93% of the postgraduates recommended the application of WBA for their peers, and 86% of them requested to perform it again for other different clinical cases and procedures. Conclusion Workplace-based assessment in the form of Mini-CEX and DOPS revealed its ability to improve clinical knowledge and skills among family medicine postgraduates who became motivated to undergo it again in search of improving their clinical performance and reducing their stresses related to final summative and objective structured clinical examinations (OSCEs).

Application of modified mini-clinical evaluation exercise (Mini-CEX) in probationary teaching of dermatology and venereology for eight-year program students / 中华医学教育探索杂志

Objective:To investigate the application of modified mini-clinical evaluation exercise (Mini-CEX) in the probationary teaching of dermatology and venereology for eight-year program students.Methods:From 2019 to 2020, a modified Mini-CEX was used to grade 58 eight-year program students at the Third Affiliated Hospital of Sun Yat-Sen University at the early, middle, and late stages of the probationary teaching of dermatology and venereology. The modifications included refining various evaluation indicators. Specifically, medical history collection involved dynamic changes in rashes, negative symptoms with differential diagnostic significance, past history/personal history/family history, and other important medical history; physical examination involved the specialized condition of rashes, systematic physical examination, and negative signs with differential diagnostic significance; humanistic care involved caring for patients, health education, and privacy protection; clinical judgment involved principles of diagnosis, differential diagnosis, and treatment; communication skills involved proficiency, prioritization, and body language; organizational effectiveness involved time allocation, patient compliance, and preparation work; overall performance involved calmness and fluency, neat writing, and preliminary clinical thinking. SPSS 20.0 was used to perform the t test. Results:Compared with the early stage of probation, the 58 eight-year program students improved their scores in clinical comprehensive ability evaluation and scores in each specific evaluation at the middle and late stages of probation ( P < 0.001). The dynamic changes in rashes and the specialized situation of rashes (identification and description of rashes) were specific to this discipline. Conclusion:The modified Mini-CEX is an objective, comprehensive, concise, and efficient assessment tool, which meets the needs of teaching reform and practice of dermatology and venereology.

A novel strategy combining Mini-CEX and OSCE to assess standardized training of professional postgraduates in department of prosthodontics.

OBJECTIVE: Mini clinical evaluation exercise (mini-CEX) and objective structured clinical examination (OSCE) are widely acknowledged as effective measures of resident standardization training (RST) in European and American countries. However, in China primary mini-CEX and OSCE forms are mainly limited in undergraduate clinical examination. Little knowledge is available regarding the validity and right way of mini-CEX /OSCE evaluation system in advanced dental clinical education so far. This study aimed to explore whether combination of mini-CEX and OSCE represents a global-dimension assessment for postgraduate clinical competence in RST. METHODS: Postgraduates who received RST from June 2017 to June 2019 were selected and evaluated by modified mini-CEX/OSCE scales. Each student received evaluations at least twice in the initial and final stages of training (tested every 4 months). A questionnaire was conducted to investigate the satisfaction with the arrangement of RST. RESULTS: Mini-CEX/OSCE test results indicated that postgraduates have significantly improved their comprehensive competence in RST projects in the department of prosthodontics (P < 0.05). Compared to other master of Stomatology students, postgraduates taking up prosthodontics master's degree have made more progresses through a training period of up to 1 year and four sessions of face-to-face feedback tutoring (P < 0.05). Survey results revealed high level of satisfaction on clinical practice evaluation. CONCLUSION: Modified mini-CEX/OSCE combined evaluation system is an effective and reliable assessment tool for clinical comprehensive ability in the RST of professional graduates and can fully highlight their respective advantages on the improvement of students' clinical competency, especially after several rounds of assessments.

Feasibility and Effectiveness of Mini-Clinical Evaluation Exercise (Mini-CEX) in an Undergraduate Medical Program: A Study From Pakistan.

Background In clinical settings, direct observation (DO) with feedback is an effective method to assess and improve learner performance. One tool used for DO is the mini-clinical evaluation exercise (Mini-CEX). We conducted a study to assess the effectiveness and feasibility of Mini-CEX for medical students at Aga Khan University, Karachi. Methods Utilizing a purposive sampling technique, a total of 199 students in six core clerkships of Years 3 and 4 were selected for this study. Participating faculty underwent training workshops for use of Mini-CEX and feedback strategies. Each student was assessed twice by one faculty, using a modified version of the Mini-CEX, which assessed four domains of clinical skills: Data Gathering, Communication, Diagnosis/Differential, and Management Plan and Organization. Feedback was given after each encounter. Faculty and students also provided detailed feedback regarding the process of DO. Data were analyzed using Statistical Package for Social Sciences (SPSS) version 26 (IBM Corp., Armonk, NY, USA), with categorical variables arranged as frequencies and percentages. The Chi-squared test was used for further statistical analyses, and a P-value of < 0.05 was considered statistically significant. Effectiveness was assessed via a change in student performance between the first and second Mini-CEX, and feasibility was assessed via qualitative feedback. Results We obtained three sets of results: Mini-CEX forms (523), from which we included a total 350 evaluations for analysis, 216 from Year 3 and 134 from Year 4, and feedback on DO: student (70) and faculty (18). Year 3 students performed significantly better in all foci of the Mini-CEX between the first and second assessment (P ≤ 0.001), whereas in Year 4, significant improvement was limited to only two domains of the Mini-CEX [Communication of History/Physical Examination (P = 0.040) and Diagnosis/Differential and Management Plan (P < 0.001)]. Students (65.7%) and faculty (94.4%) felt this exercise improved their interaction. 83.3% faculty recommended its formal implementation compared to 27.1% of students, who reported challenges in implementation of the Mini-CEX such as time constraints, logistics, the subjectivity of assessment, and varying interest by faculty. Conclusion Direct observation using Mini-CEX is effective in improving the clinical and diagnostic skills of medical students and strengthens student-faculty interaction. While challenges exist in its implementation, the strategic placement of Mini-CEX may enhance its utility in measuring student competency.

[Workplace-based Assessments: A Needs Analysis of Residents and Supervisors]. / Arbeitsplatz-basierte Assessments: eine Bedarfsanalyse bei Assistenzärztinnen und ­ärzten sowie ihren Supervisierenden.

Workplace-based Assessments: A Needs Analysis of Residents and Supervisors Abstract. During residency training, four workplace-based assessments (WBA) are planned per year in the form of Mini-CEX and/or DOPS. They were introduced as a tool for giving feedback and defining learning objectives in the clinical setting. The aim of the present study is to identify facilitating and inhibiting factors. The results will provide information to improve the use of this learning tool to effectively promote learning in the workplace. First, all users must be trained in its use. In particular, it is important to provide immediate and specific feedback that identifies opportunities for improvement and sets achievable learning goals. Documentation should be user-friendly and provide an overview of the learning process. WBAs should not be perceived as a duty, but as a tool for valuable learning moments.

Current Trends in Mini-Clinical Evaluation Exercise in Medical Education: A Bibliometric Analysis.

There has been emerging evidence supporting the mini-clinical evaluation exercise (mini-CEX) in various clinical specialties and settings. However, we need more clarity regarding the applicability of mini-CEX as an optimal assessment tool. Consequently, it has not been implemented on a wider scale, and several clinical specialties are yet to explore the benefits of mini-CEX. Therefore, we conducted a bibliometric analysis to investigate the publication trends of mini-CEX. We searched the Web of Science database for mini-CEX-related original and review articles. The search results were analyzed for year-wise contribution, citation trends, contributing journals, contributing institutions, countries, authors, distribution of original/review articles, retrospective/prospective/laboratory/other types of studies, specialties covered, nature of medical education (undergraduate vs. specialty trainees), and clinical settings involved in the studies (single/multiple). A total of 59 eligible articles (53 original and six review articles) were published between 1995 and 2022 in 35 different journals. The mean citations per year were 65.96 per year, and the mean citations per article per year were 2.34 citations per article per year. The articles published in BMC Medical Education and Medical Teacher were the highest in number. In total, 97 institutes contributed to the mini-CEX-related research, mostly from the University of Bern, Switzerland. There were 238 contributing authors, with Norcini JJ contributing the most number of articles. The remaining articles were 15 retrospective studies, one developmental study, six review articles, and three laboratory-based studies. The 50 non-laboratory studies involved students/trainees in medical and allied fields. Medicine was the most frequently covered specialty. The participants were mostly specialty trainees, followed by undergraduate medical students. Multiple settings were used in 38% of the reviewed studies and single in 16%. The published articles have reduced impact and growth, as evidenced by low annual growth rates and citation trends. However, the available evidence was of reasonable quality considering the contribution from mostly prospective studies. Furthermore, it suggests considerable potential for further investigating the role of mini-CEX in clinical teaching.

Is the rating result reliable? A new approach to respond to a medical trainee's concerns about the reliability of Mini-CEX assessment.

PURPOSE: Whether the rating result of mini-clinical evaluation exercise (Mini-CEX) for rating clinical skills is reliable is of a medical trainee's great concerns. The objectives of this study were to analyze the test-retest reliability, interrater reliability and internal consistency reliability of Mini-CEX. METHODS: Three clinical scenarios, each played by a standardized patient and resident, were developed and videotaped. A group of assessors were recruited to rate the resident's clinical skills using Mini-CEX with a nine-point grading scale in each videotaped clinical scenario. Each assessor was required: (1) to watch the videotaped clinical scenarios a sequential order; (2) to rate each medical trainee's clinical skills in each clinical scenario for two rating sessions, and there must be a minimum three-week interval between the first and the second Mini-CEX rating session. RESULTS: A total of 38 assessors participated in this study. This study showed that: (1) an assessor carried out similar rating reuslts under the same clinical performance based on an acceptable test-retest reliability (Pearson's correlation coefficients = 0.24-0.76, P value=<0.01-0.14); (2) assessors gave similar rating results to a medical trainee's clinical performance based on a good interrater reliability (intra-class correlation coefficient = 0.57-0.83, P value=<0.01-0.03); and (3) the items reflected unidimensionally a construct-a medical trainee's clinical skills based on an excellent internal consistency reliability (Cronbach's alpha = 0.92-0.97). CONCLUSION: This study convincingly showed that Mini-CEX is a reliable assessment tool for rating clinical skills, and can be widely used to assess medical trainees' clinical skills.

Application of scenario simulation teaching combined with Mini-CEX in standardized residency training of general surgery / 中华医学教育探索杂志

Objective:To study the application effect of scenario simulation teaching combined with mini-clinical evaluation exercise (Mini-CEX) in the standardized residency training of general surgery.Methods:The study included in 62 trainees who had standardized residency training in the Department of General Surgery of the Affiliated Hospital of Xuzhou Medical University From July 2019 to July 2020. The subjects were randomly divided into traditional teaching group (control group) and scenario simulation teaching combined with Mini-CEX teaching group (experimental group), with 31 students in each group. The scores of the entrance examination, Mini-CEX scores and the evaluation of teaching effect were compared between the two groups. SPSS 21.0 was used to perform t test on the test scores, Mini-CEX scores and teaching effective evaluation scores of the two groups. Results:①The theoretical scores of the experimental group [(82.48 ± 6.02) points] were significantly higher than those of the control group [(77.32±6.25) points], with significant differences ( t=3.31, P<0.01). The clinical practice scores of the experimental group [(88.96 ± 2.93) points] were significantly higher than those of the control group [(80.87±5.41) points], with significant differences ( t=7.33, P<0.01). ②Mini-CEX scores of the experimental group were higher than those of the control group ( P<0.01). ③Through the teaching questionnaire, the scores of the experimental group were higher than those of the control group ( P<0.01). Conclusion:Scenario simulation teaching combined with Mini-CEX has achieved good results in the standardized residency training of general surgery, which could be used as a new clinical teaching mode.

Acceptability and Feasibility of Mini Clinical Evaluation Exercise (Mini-CEX) in the Busy Emergency Department.

BACKGROUND: Mini Clinical Evaluation Exercise (Mini-CEX) has been adapted to different specialties in clinical practice but with very little evidence documented about its use for residency training in the emergency department (ED). This study aims to assess its acceptability and feasibility as a formative tool in the busy emergency department. MATERIALS AND METHODS: Both the faculty members and the emergency medicine residents were sent a validated questionnaire using Google forms, and the results were analyzed using simple statistical tools. RESULTS: Forty-nine residents and 58 faculty participated in the survey. The study was carried out over a period of 4 months. The resident's completion rate was 96% (49 out of 51), while faculty completion rate was 96% (58 out of 60). The time for Mini-CEX completion ranged from 10 to 20 minutes. Most of the residents were satisfied with Mini-CEX as an assessment tool. Twelve residents expressed their concern regarding available time during busy clinical shifts. Most of the faculty agreed with the benefits of using Mini-CEX as a formative assessment tool. Several of them commented that they need "protected time" and "more training" to use this tool to provide maximum benefit to the residents. CONCLUSION: Despite busy nature of ED, Mini-CEX has been identified as an acceptable learning tool for residents in emergency medicine. Based on the faculty's feedback and comments, several faculty development workshops were conducted to improve faculty skills in carrying assessments by using Mini-CEX, and protected time is provided to some faculty members to carry out these formative assessments for the benefit of the residents.

The Effect of Repeated Direct Observation of Procedural Skills (R-DOPS) Assessment Method on the Clinical Skills of Anesthesiology Residents.

BACKGROUND: The ultimate result of patient care is one of the most important outcomes in medical education. Several methods, including the direct observation of procedural skills (DOPS), have been proposed to assess professional competencies in clinical practice. OBJECTIVES: This study aimed to assess the effects of the Repeated DOPS (R-DOPS) method on the performance of procedural skills in anesthesiology residents. METHODS: The procedural skill performance of anesthesiology residents was assessed using a standard DOPS protocol from May to October 2019. Their scores were then objectively recorded, and the satisfaction rates regarding the 2 DOPS exams were assessed. RESULTS: We found a considerable improvement in anesthesiology residents' procedural skill performance, especially in the anesthesiology residency curriculum's basic items. Besides, anesthesiology residents' satisfaction was significantly improved after the 2nd DOPS. CONCLUSIONS: R-DOPS leads to improved training outcomes, including assessing the procedural skills, time to feedback to trainees, and trainee satisfaction.

PJplus - a project improving practical training during the final year of medical education.

BACKGROUND: Practical training on the patient is crucial in medical students' last year education - the so-called practical year (PJ) in Germany. Due to difficulties in combining student training with the everyday tasks on ward, it is often criticised as not sufficient for a good preparation for later practical work. The Medical Faculty of the University of Jena therefore designed a project called "PJplus". The project includes mentoring and workplace-based assessment by means of Mini-Clinical Evaluation Exercise (Mini-CEX) in combination with training workshops for supervisors. Three years after the first clinical departments started voluntary participation, the project was evaluated by comparing the experience and the self-assessed learning progress of students from departments participating in this project (PJplus group) with those non-participating (control group). METHODS: An online questionnaire was sent to all medical students registered at the University of Jena for PJ between March 2016 and April 2017. The students were invited to participate at the end of each section of their PJ within that period. The answers of the PJplus group were compared to the answers of the control group using descriptive and multivariable analysis. RESULTS: 201 students participated in the survey and filled out 257 questionnaires. PJplus was recommended by 80% of the students participating in the project. The PJplus group (n=92) was significantly more satisfied with their PJ and felt significantly better prepared for work than the control group (n=165). The project's elements mentoring and feedback could lead to a better improvement in practical medical skills. However, only 17% of the students managed to conduct the required amount of three Mini-CEX during their PJ rotation and 52% of the students seemed to have lost contact to their mentor or did not have one at all. These difficulties arose due to unfamiliarity with the project, shortage of time and staff on ward or due to lack of motivation among supervisors. CONCLUSION: Adding mentoring and feedback to the PJ helps to better prepare students for their practical work after finishing studies. With the project presented, it is feasible to integrate these elements in a structured way. Nevertheless, a good control of the elements' implementation and consistent training of the supervising physicians is needed to ensure long-term success.

Using peer role-playing to improve students' clinical skills for musculoskeletal physical examinations.

BACKGROUND: The traditional curriculum for medical students in Japan does not include sufficient opportunities for students to develop their skills for musculoskeletal (MSK) examination and clinical reasoning and diagnosis. Therefore, an effective programme is required to help medical students and residents improve their clinical skills in MSK. This paper aims to assess the clinical skills of medical students who have participated in a peer role-playing simulation programme using a mini clinical evaluation exercise (mini-CEX). METHODS: Participants were 90 female medical students who were completing their first orthopaedic clinical clerkship. They were divided into two groups. The simulation group participated in a role-play focussed on MSK cases as low-fidelity simulation, a structured debriefing with the course supervisor, and a self-reflection on Day 1 (n = 64). The control group did not participate in the role-play due to randomised clerkship schedules (n = 26). On Day 2 of the intervention, we observed and assessed all participants' performances during MSK outpatient encounters using the mini-CEX. We compared the mini-CEX score between the simulation group and the control group; the Wilcoxon rank-sum test was used for statistical analysis. RESULTS: The mini-CEX scores for physical examination, clinical reasoning and diagnosis, and overall clinical competency were significantly higher in the simulation group than in the control group (p < .05, physical examination: p = .014, clinical reasoning: p = .042, overall: p = .016). These findings suggest that medical students who partake in a peer role-playing simulation programme could experience improved clinical skills for physical examination, clinical reasoning and diagnosis, and overall clinical competency in real-life MSK outpatient encounters. CONCLUSIONS: Through a mini-CEX assessment, our findings indicate that medical students who participated in our peer role-playing simulation programme have improved clinical skills. Peer role-playing as a low-fidelity simulation and practical educational opportunity will enable educators to polish the competency of medical students in musculoskeletal physical examinations and clinical reasoning and diagnosis in a clinical setting.

Chinese doctors' views on workplace-based assessment: trainee and supervisor perspectives of the mini-CEX.

Purpose: This study investigated whether the mini-clinical evaluation exercise (mini-CEX) has been successfully integrated into the Chinese context, following its introduction as part of the national general training programme. Materials and methods: Online questionnaires (N = 91) and interviews (N = 22) were conducted with Year 1 trainee doctors and clinical supervisors at a cancer hospital in China to explore users' experiences, attitudes and opinions of the mini-CEX. Results" Trainees were more likely than supervisors to report understanding the purpose of the mini-CEX and agree that it encouraged reflection and helped improve overall performance. Both trainees and supervisors felt that it provided a framework for learning, that it was useful in identifying underperformance, and that it informed learning progression. Groups were equally positive about the commitment of their counterpart in the process and valued the focus on detailed feedback. It was perceived as cultivating the learner-teacher relationship. Overall, both groups felt they 'bought in' to using the mini-CEX. However, concerns were raised about subjectivity of ratings and lack of benchmarking with expected standards of care. Conclusions: Chinese trainees and supervisors generally perceived the mini-CEX as an acceptable and valuable medical training tool, although both groups suggested enhancements to improve its efficacy.